Method for providing poi information for mobile terminal and apparatus thereof

ABSTRACT

A method and apparatus for providing point of interest (POI) information of a mobile terminal are disclosed to extract and provide POI information and/or road information included in an image captured by a camera. Location information of an image capture place and image capture direction information are read from the digital photo image, the POI information corresponding to the location and image capture direction information is extracted from map data, and the extracted POI information is displayed on the digital photo image.

CROSS REFERENCE TO RELATED APPLICATIONS

This nonprovisional application claims priority under 35 U.S.C. §119(a)from Patent Application No. 10-2008-0114240, filed in the Republic ofKorea on Nov. 17, 2008, the entire contents of which are herebyincorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a method and apparatus for providingPOI (Point of Interest or Point of Information) information of a mobileterminal.

2. Description of the Background Art

In general, a vehicle navigation device applied to a mobile terminal, inparticular, to a telematics terminal, is a device for generating roadguidance information based on a global positioning system (GPS) signaland map information, and providing the road guidance information to auser. In addition, the vehicle navigation device provides POIinformation to the user.

FIG. 1 illustrates the background art vehicle navigation system.

As shown in FIG. 1, the background art vehicle navigation systemincludes an information providing center 3 providing trafficinformation, and a telematics terminal 4 which may be mounted within avehicle or carried by a user, receives traffic information via awireless communication network 2, and provides a road guidance service,based on a GPS signal received via an artificial satellite 1, and thetraffic information.

SUMMARY OF THE INVENTION

According to an aspect of the invention, there is provided a method forproviding POI information of a mobile terminal, including: readinglocation information of an image capture place from a digital photoimage and information about an image capture direction; extracting POI(Point Of Interest) information corresponding to the location and imagecapture direction information from map data; and displaying theextracted POI information on the digital photo image.

The POI information corresponding to the location information of theimage capture place, the image capture direction information, altitudeinformation of the image capture place, and image capture angleinformation from the digital photo image may be extracted from the mapdata.

The POI information extracted from the map data may be matched to thedigital photo image.

The POI information extracted from the map data may be recorded on thedigital photo image.

One or more of the name, the address, and a phone number of a buildingcorresponding to the POI information extracted from the map data may bedisplayed on the digital photo image.

When the POI information displayed on the digital photo image isselected, the selected POI information may be set as a destination.

According to another aspect of the invention, there is provided anapparatus for providing POI information of a mobile terminal, including:a storage unit configured to store map data; and a controller configuredto read location information of an image capture place and image capturedirection information from a digital photo image, extract POIinformation corresponding to the location and image capture directioninformation from the map data, and display the extracted POI informationon the digital photo image.

The POI information corresponding to the location information of theimage capture place, the image capture direction information, altitudeinformation of the image capture place, and image capture angleinformation from the digital photo image may be extracted from the mapdata.

The POI information extracted from the map data may be matched to thedigital photo image.

The POI information extracted from the map data may be recorded on thedigital photo image.

One or more of the name, the address, and a phone number of a buildingcorresponding to the POI information extracted from the map data may bedisplayed on the digital photo image.

When the POI information displayed on the digital photo image isselected, the selected POI information may be set as a destination.

The foregoing and other objects, features, aspects and advantages of thepresent invention will become more apparent from the following detaileddescription of the present invention when taken in conjunction with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates the related art vehicle navigation system;

FIG. 2 is a schematic block diagram showing a configuration of a mobilecommunication terminal employing a point of interest (POI) informationproviding apparatus according to an embodiment of the present invention;

FIG. 3 is a schematic block diagram showing a configuration of atelematics terminal employing a point of interest (POI) informationproviding apparatus according to an embodiment of the present invention;

FIG. 4 is a schematic block diagram showing a configuration of anavigation device employing the POI information providing apparatusaccording to an embodiment of the present invention;

FIG. 5 is a flow chart illustrating a method for providing POIinformation according to a first embodiment of the present invention;

FIG. 6 illustrates a digital photo image captured by the POI informationproviding apparatus according to the first embodiment of the presentinvention;

FIG. 7 illustrates map data read by the POI information providingapparatus according to the first embodiment of the present invention;

FIG. 8 illustrates POI information (including road information) matchedto the digital photo image by the POI information providing apparatusaccording to the first embodiment of the present invention;

FIG. 9 is a flow chart illustrating a method for providing POIinformation according to a second embodiment of the present invention;

FIG. 10 illustrates a POI picture list key according to the secondembodiment of the present invention;

FIG. 11 illustrates a POI picture list according to the secondembodiment of the present invention;

FIG. 12 illustrates a digital photo image linked to the POI picture listaccording to the second embodiment of the present invention; and

FIG. 13 illustrates a pop-up window for setting POI information as adestination according to the second embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

A method and apparatus for providing point of interest (POI) informationof a mobile terminal capable of recording and displaying POI informationon a photo image captured by a camera based on location information andimage capture direction information included in the photo image, andproviding road guidance information based on the recorded and displayedPOI information according to exemplary embodiments of the presentinvention will now be described with reference to FIGS. 2 to 13.

FIG. 2 is a schematic block diagram showing the configuration of amobile communication terminal employing a point of interest (POI)information providing apparatus according to an embodiment of thepresent invention. The mobile communication terminal (mobile phone) 100may be implemented in various forms. For example, the mobile terminaldescribed in the present invention may include mobile phones, smartphones, notebook computers, digital broadcast terminals, PDAs (PersonalDigital Assistants), PMPs (Portable Multimedia Player), navigationdevices (vehicle navigation devices), GPS cameras, and the like. The GPScamera is a device for recording location information on photo imagedata captured based on a GPS signal. Methods for recording location dataon photo image data are disclosed in Japanese Patent No. 2003-283977,Japanese Patent No. 2004-252081, Japanese Patent No. 2007-114942,Japanese Patent No. 2008-118695, the entire contents of which beinghereby incorporated by reference.

As shown in FIG. 2, the mobile communication terminal 100 includes awireless communication unit 110, an A/V (Audio/Video) input unit 120, auser input unit 130, a sensing unit 140, an output unit 150, a memory160, an interface unit 170, a controller 180, and a power supply unit190, etc. FIG. 1 shows the mobile terminal 100 having variouscomponents, but it is understood that implementing all of theillustrated components is not a requirement. The mobile terminal 100 maybe implemented by greater or fewer components.

The wireless communication unit 110 typically includes one or morecomponents allowing radio communication between the mobile terminal 100and a wireless communication system or a network in which the mobileterminal is located. For example, the wireless communication unit mayinclude at least one of a broadcast receiving module 111, a mobilecommunication module 112, a wireless Internet module 113, a short-rangecommunication module 114, and a location information module 115.

The broadcast receiving module 111 receives broadcast signals and/orbroadcast associated information from an external broadcast managementserver (or other network entity) via a broadcast channel. The broadcastchannel may include a satellite channel and/or a terrestrial channel.The broadcast management server may be a server that generates andtransmits a broadcast signal and/or broadcast associated information ora server that receives a previously generated broadcast signal and/orbroadcast associated information and transmits the same to a terminal.The broadcast associated information may refer to information associatedwith a broadcast channel, a broadcast program or a broadcast serviceprovider. The broadcast signal may include a TV broadcast signal, aradio broadcast signal, a data broadcast signal, and the like. Also, thebroadcast signal may further include a broadcast signal combined with aTV or radio broadcast signal.

The broadcast associated information may also be provided via a mobilecommunication network and, in this case, the broadcast associatedinformation may be received by the mobile communication module 112. Thebroadcast signal may exist in various forms. For example, it may existin the form of an electronic program guide (EPG) of digital multimediabroadcasting (DMB), electronic service guide (ESG) of digital videobroadcast-handheld (DVB-H), and the like.

The broadcast receiving module 111 may be configured to receive signalsbroadcast by using various types of broadcast systems. In particular,the broadcast receiving module 111 may receive a digital broadcast byusing a digital broadcast system such as multimediabroadcasting-terrestrial (DMB-T), digital multimediabroadcasting-satellite (DMB-S), digital video broadcast-handheld(DVB-H), the data broadcasting system known as media forward link only(MediaFLO®), integrated services digital broadcast-terrestrial (ISDB-T),etc. The broadcast receiving module 111 may be configured to be suitablefor every broadcast system that provides a broadcast signal as well asthe above-mentioned digital broadcast systems. Broadcast signals and/orbroadcast-associated information received via the broadcast receivingmodule 111 may be stored in the memory 160 (or anther type of storagemedium).

The mobile communication module 112 transmits and/or receives radiosignals to and/or from at least one of a base station (e.g., accesspoint, Node B, etc.), an external terminal (e.g., other user devices)and a server (or other network entities). Such radio signals may includea voice call signal, a video call signal or various types of dataaccording to text and/or multimedia message transmission and/orreception.

The wireless Internet module 113 supports wireless Internet access forthe mobile terminal. This module may be internally or externally coupledto the terminal.

The short-range communication module 114 is a module for supportingshort range communications. Some examples of short-range communicationtechnology include Bluetooth™, Radio Frequency IDentification (RFID),Infrared Data Association (IrDA), Ultra-WideBand (UWB), ZigBee™, and thelike.

The location tracking module 115 is a module for checking or acquiring alocation (or position) of the mobile terminal. For example, the locationtracking module 115 may be embodied by using a GPS (Global PositioningSystem) module that receives location information from a plurality ofsatellites. Here, the location information may include coordinateinformation represented by latitude and longitude values. For example,the GPS module may measure an accurate time and distance from three ormore satellites, and accurately calculate a current location of themobile terminal according to trigonometry based on the measured time anddistances. A method of acquiring distance and time information fromthree satellites and performing error correction with a single satellitemay be used. In particular, the GPS module may acquire an accurate timetogether with three-dimensional speed information as well as thelocation of the latitude, longitude and altitude values from thelocation information received from the satellites. As the locationtracking module 115, a Wi-Fi position system and/or hybrid positioningsystem may be used.

The A/V input unit 120 is configured to receive an audio or videosignal. The AN input unit 120 may include a camera 121 (or other imagecapture device) and a microphone 122 (or other sound pick-up device).The camera 121 processes image data of still pictures or video obtainedby an image capture device in a video capturing mode or an imagecapturing mode. The processed image frames may be displayed on a displayunit 151 (or other visual output device).

The image frames processed by the camera 121 may be stored in the memory160 (or other storage medium) or transmitted via the wirelesscommunication unit 110. Two or more cameras 121 may be providedaccording to the configuration of the mobile terminal.

The microphone 122 may receive sounds (audible data) via a microphone(or the like) in a phone call mode, a recording mode, a voicerecognition mode, and the like, and can process such sounds into audiodata. The processed audio (voice) data may be converted for output intoa format transmittable to a mobile communication base station (or othernetwork entity) via the mobile communication module 112 in case of thephone call mode. The microphone 122 may implement various types of noisecanceling (or suppression) algorithms to cancel (or suppress) noise orinterference generated in the course of receiving and transmitting audiosignals.

The user input unit 130 (or other user input device) may generate keyinput data from commands entered by a user to control various operationsof the mobile terminal. The user input unit 130 allows the user to entervarious types of information, and may include a keypad, a dome switch, atouch pad (e.g., a touch sensitive member that detects changes inresistance, pressure, capacitance, etc. due to being contacted) a jogwheel, a jog switch, and the like. In particular, when the touch pad isoverlaid on the display unit 151 in a layered manner, it may form atouch screen.

The sensing unit 140 (or other detection means) detects a current status(or state) of the mobile terminal 100 such as an opened or closed stateof the mobile terminal 100, a location of the mobile terminal 100, thepresence or absence of user contact with the mobile terminal 100 (i.e.,touch inputs), the orientation of the mobile terminal 100, anacceleration or deceleration movement and direction of the mobileterminal 100, etc., and generates commands or signals for controllingthe operation of the mobile terminal 100. For example, when the mobileterminal 100 is implemented as a slide type mobile phone, the sensingunit 140 may sense whether the slide phone is opened or closed. Inaddition, the sensing unit 140 can detect whether or not the powersupply unit 190 supplies power or whether or not the interface unit 170is coupled with an external device.

The interface unit 170 (or other connection means) serves as aninterface by which at least one external device may be connected withthe mobile terminal 100. For example, the external devices may includewired or wireless headset ports, an external power supply (or batterycharger) ports, wired or wireless data ports, memory card ports, portsfor connecting a device having an identification module, audioinput/output (I/O) ports, video I/O ports, earphone ports, or the like.Here, the identification module may be a memory chip (or other elementwith memory or storage capabilities) that stores various information forauthenticating user's authority for using the mobile terminal 100 andmay include a user identity module (UIM), a subscriber identity module(SIM) a universal subscriber identity module (USIM), and the like. Inaddition, the device having the identification module (referred to asthe ‘identifying device’, hereinafter) may take the form of a smartcard. Accordingly, the identifying device may be connected with theterminal 100 via a port or other connection means. The interface unit170 may be used to receive inputs (e.g., data, information, power, etc.)from an external device and transfer the received inputs to one or moreelements within the mobile terminal 100 or may be used to transfer databetween the mobile terminal and an external device.

The output unit 150 is configured to provide outputs in a visual,audible, and/or tactile manner (e.g., audio signal, video signal, alarmsignal, vibration signal, etc.). The output unit 150 may include thedisplay unit 151, an audio output module 152, an alarm unit 153, ahaptic module 154, and the like.

The display unit 151 may display information processed in the mobileterminal 100. For example, when the mobile terminal 100 is in a phonecall mode, the display unit 151 may display a User Interface (UI) or aGraphic User Interface (GUI) associated with a call or othercommunication (such as text messaging, multimedia file downloading,etc.). When the mobile terminal 100 is in a video call mode or imagecapturing mode, the display unit 151 may display a captured image and/orreceived image, a UI or GUI that shows videos or images and functionsrelated thereto, and the like.

When the display unit 151 and the touch pad are overlaid in a layeredmanner to form a touch screen, the display unit 151 may function as bothan input device and an output device. The display unit 151 may includeat least one of a Liquid Crystal Display (LCD), a Thin FilmTransistor-LCD (TFT-LCD), an Organic Light Emitting Diode (OLED)display, a flexible display, a three-dimensional (3D) display, or thelike. The mobile terminal 100 may include two or more display units (orother display means) according to its particular desired embodiment. Forexample, the mobile terminal may include both an external display unit(not shown) and an internal display unit (not shown).

The audio output module 152 may convert and output as sound audio datareceived from the wireless communication unit 110 or stored in thememory 160 in a call signal reception mode, a call mode, a record mode,a voice recognition mode, a broadcast reception mode, and the like.Also, the audio output module 152 may provide audible outputs related toa particular function performed by the mobile terminal 100 (e.g., a callsignal reception sound, a message reception sound, etc.). The audiooutput module 152 may include a speaker, a buzzer, or other soundgenerating device.

The alarm unit 153 (or other type of user notification means) mayprovide outputs to inform about the occurrence of an event of the mobileterminal 100. Typical events may include call reception, messagereception, key signal inputs, a touch input etc. In addition to audio orvideo outputs, the alarm unit 153 may provide outputs in a differentmanner to inform about the occurrence of an event. For example, thealarm unit 153 may provide an output in the form of vibrations (or othertactile or sensible outputs). When a call, a message, or some otherincoming communication is received, the alarm unit 153 may providetactile outputs (i.e., vibrations) to inform the user thereof. Byproviding such tactile outputs, the user can recognize the occurrence ofvarious events even if his mobile phone is in the user's pocket. Outputsinforming about the occurrence of an event may be also provided via thedisplay unit 151 or the audio output module 152.

A haptic module 154 generates various tactile effects the user may feel.A typical example of the tactile effects generated by the haptic module154 is vibration. The strength and pattern of the haptic module 154 canbe controlled. For example, different vibrations may be combined to beoutputted or sequentially outputted.

Besides vibration, the haptic module 154 may generate various othertactile effects such as an effect by stimulation such as a pinarrangement vertically moving with respect to a contact skin, a sprayforce or suction force of air through a jet orifice or a suctionopening, a contact on the skin, a contact of an electrode, electrostaticforce, etc., an effect by reproducing the sense of cold and warmth usingan element that can absorb or generate heat.

The haptic module 154 may be implemented to allow the user to feel atactile effect through a muscle sensation such as fingers or arm of theuser, as well as transferring the tactile effect through a directcontact. Two or more haptic modules 154 may be provided according to theconfiguration of the mobile terminal 100. For example, the haptic module154 may be provided at a steering wheel, a gear shift lever, a seat of acar, and the like.

The memory 160 may store programs used for the processing andcontrolling operations performed by the controller 180, or maytemporarily store data (e.g., a phonebook, messages, still images,video, etc.) that are inputted or outputted.

The memory 160 may include at least one type of storage medium includinga Flash memory, a hard disk, a multimedia card micro type, a card-typememory (e.g., SD or DX memory, etc), a Random Access Memory (RAM), aStatic Random Access Memory (SRAM), a Read-Only Memory (ROM), anElectrically Erasable Programmable Read-Only Memory (EEPROM), aProgrammable Read-Only memory (PROM), a magnetic memory, a magneticdisk, and an optical disk. Also, the mobile terminal 100 may be operatedin relation to a web storage device that performs the storage functionof the memory 160 over the Internet.

The controller 180 typically controls the general operations of themobile terminal. For example, the controller 180 performs controllingand processing associated with voice calls, data communications, videocalls, and the like. The controller 180 may include a multimedia module181 for reproducing multimedia data. The multimedia module 181 may beconfigured within the controller 180 or may be configured to beseparated from the controller 180.

The power supply unit 190 receives external power or internal power andsupplies appropriate power required for operating respective elementsand components under the control of the controller 180.

Various embodiments described herein may be implemented in acomputer-readable or its similar medium using, for example, software,hardware, or any combination thereof.

For hardware implementation, the embodiments described herein may beimplemented by using at least one of application specific integratedcircuits (ASICs), digital signal processors (DSPs), digital signalprocessing devices (DSPDs), programmable logic devices (PLDs), fieldprogrammable gate arrays (FPGAs), processors, controllers,micro-controllers, microprocessors, electronic units designed to performthe functions described herein. In some cases, such embodiments may beimplemented by the controller 180 itself.

For a software implementation, the embodiments such as procedures orfunctions may be implemented together with separate software modulesthat allow performing of at least one function or operation. Softwarecodes can be implemented by a software application (or program) writtenin any suitable programming language. The software codes may be storedin the memory 160 and executed by the controller 180.

A navigation session 182 applied to the mobile communication terminal100 generates road guidance information and provides the generated roadguidance information to the user.

A POI information providing apparatus of the mobile communicationterminal 100 according to an embodiment of the present inventionincludes: the memory 160 for storing map data; and the controller 180for reading location information and image capture direction informationincluded in a digital photo image captured by the camera 121, readingmap data corresponding to the location information and image capturedirection information from the memory 160, extracting POI informationand/or road information included in the digital photo image from theread map data, and recording the extracted POI information and/or roadinformation on the digital photo image. Here, the image capturedirection information may be detected by a digital compass, which is aknown art, so its description will be omitted.

The navigation session 182 displays the digital photo image having aplurality of POI information on the display unit 151. When particularPOI information is selected from among the plurality of POI informationby the user, the navigation session 182 may set the selected POIinformation as a destination and guide a travel route from a currentlocation to the set destination.

Hereinafter, the configuration of a telematics terminal 200 employingthe POI information providing apparatus according to an embodiment ofthe present invention will now be described with reference to FIG. 3.

FIG. 3 is a schematic block diagram showing the configuration of thetelematics terminal 200 employing the POI information providingapparatus according to an embodiment of the present invention.

As shown in FIG. 3, the telematics terminal 200 includes a main board210 including a central processing unit (CPU) 212 for controlling thetelematics terminal 200 overall, a memory 213 for storing variousinformation, a key controller 211 for controlling various key signals,and an LCD controller 214 for controlling an LCD.

The memory 213 stores map information (map data) for displaying roadguidance information on a digital map. Also, the memory 213 stores atraffic information collecting control algorithm for inputting trafficinformation according to the situation of a road along which the vehiclecurrently travels (runs), and information for controlling the algorithm.

The telematics terminal 200 includes a CDMA module 206, a mobileterminal having a unique device number as assigned and installed in thevehicle, a GPS module 207 for receiving a GPS signal for guiding thelocation of the vehicle or tracking a travel route from a start point toa destination, or transmitting traffic information collected by the useras a GPS signal, a CD deck 208 for reproducing a signal recorded in a CD(Compact Disk), a gyro sensor 209, or the like. The CDMA module 206 andthe GPS module 207 receive signals via antennas 204 and 205.

A TV module 222 may also be connected with the main board 210 to receivea TV signal via a TV antenna 223. An LCD 201 under the control of theLCD controller 214, a front board 202 under the control of the keycontroller 211, and a camera 227 for capturing images of the interiorand/or exterior of the vehicle may be connected to the main board 210via an interface board 203. The LCD 201 displays various video signalsand character signals, and the front board 202 includes buttons forvarious key signal inputs and provides a key signal corresponding to abutton selected by the user to the main board 210. The front board 202includes a menu key for directly inputting traffic information. The menukey may be configured to be controlled by the key controller 211.

An audio board 217 is connected with the main board 210 and processesvarious audio signals. The audio board 217 includes a microcomputer 219for controlling the audio board 217, a tuner 218 for receiving a radiosignal, a power source unit 216 for supplying power to the microcomputer219 and a signal processing unit 215 for processing various voicesignals.

The audio board 217 is connected to a radio antenna 220 for receiving aradio signal and a tape deck 221 for reproducing an audio tape. Theaudio board 217 may further include a voice output unit (e.g., anamplifier) 226 for outputting a voice signal processed by the audioboard 217.

The voice output unit (i.e., amplifier) 226 is connected to a vehicleinterface 224. Namely, the audio board 217 and the main board 210 areconnected to the vehicle interface 224. A handsfree 225 a for inputtinga voice signal, an airbag 225 b configured for the security of apassenger, a speed sensor 225 c for detecting the speed of the vehicle,or the like, may be connected to the vehicle interface 224. The speedsensor 225 c calculates a vehicle speed and provides the calculatedvehicle speed information to the CPU 212.

A navigation session 300 applied to the telematics terminal 200generates road guidance information based on the map data and currentlocation information of the vehicle and provides the road guidanceinformation to a user.

The POI information providing apparatus of the telematics terminal 200according to an embodiment of the present invention includes: a memory213 for storing map data; and a CPU 212 for reading location informationand image capturing direction information included in a digital photoimage captured by the camera 227, reading map data corresponding to thelocation information and the image capture direction information fromthe memory 213, extracting POI information and/or road informationincluded in the digital photo image from the read map data, andrecording the extracted POI information and/or road information on thedigital photo image. Here, the image capture direction information maybe detected through a digital compass or vehicle travel directioninformation. This is a known art, so its detailed description will beomitted. The POI information providing apparatus of the telematicsterminal 200 can provide more accurate POI information and/or roadinformation included in the digital photo image by adding altitude dataof the place where the digital photo image is captured and image captureangle data to the digital photo image.

In addition, the navigation session 300 may display the digital photoimage having a plurality of pieces of POI information on the displayunit 201, and when particular POI information is selected from theplurality of pieces of POI information by the user, the navigationsession 300 may set the selected POI information as a destination andguide a travel path from the current location to the set destination.

Here, the function of the navigation session 300 according to theembodiment of the present invention may be performed by the CPU 212 ofthe telematics terminal 200.

Hereinafter, the POI information providing apparatus according to anembodiment of the present invention will now be described in detail byapplying the navigation device of the telematics terminal 200. Thenavigation device may be applied to the telematics terminal 200 or maybe independently configured rather than being applied to the mobilecommunication terminal 100.

FIG. 4 is a schematic block diagram showing the configuration of thenavigation device employing the POI information providing apparatusaccording to an embodiment of the present invention. Here, for elementsin FIG. 4 having the same function as those in FIG. 3, the samereference numerals will be used.

As shown in FIG. 4, a navigation device 400 employing the POIinformation providing apparatus according to an embodiment of thepresent invention includes a GPS module 207 that receives a GPS signalfrom a satellite and generates first vehicle location data of thenavigation device (at the same position as the telematics terminal 200or the mobile communication terminal 100) based on the received GPSsignal; a dead-reckoning (DR) sensor 401 that generates second vehiclelocation data based on a travel direction of a vehicle and the speed ofthe vehicle; a memory (or a storage unit) 213 that stores map data; amap matching unit 402 that generates a vehicle estimation location basedon the first and second vehicle location data, matches the generatedvehicle estimation location and a link in map data (i.e., map matchinglink or map matching road) stored in the storage unit 213, and outputsthe matched map information (map matching result); a communication unit404 that receives real time traffic information from the informationproviding center 600 via a wireless communication network 500; acontroller 403 that generates road guidance information based on thematched map information (map matching result), extracts the POTinformation and/or road information included in the digital photo imagefrom the map data based on the location information and image capturedirection information included in the digital photo image captured bythe camera 227, and records and displays the extracted POI informationand/or road information on the digital photo image; a display unit 201that displays a road guidance map included in the road guidanceinformation; and a voice output unit 226 that outputs road guidancevoice information (road guidance voice message) included in the roadguidance information.

The POI information providing apparatus according to an embodiment ofthe present invention can additionally record altitude data of the placewhere the digital photo image is captured and image capture angle datato provide more accurate POI information and/or road informationincluded in the digital photo image. For example, the POI informationproviding apparatus according to an embodiment of the present inventionmay further include: an altitude detecting unit (not shown) that detectsthe altitude of the image capture place; and an angle detecting unit(not shown) that detects the image capture angle. The POI informationproviding apparatus applied to the telematics terminal 200 may recordcurrent vehicle location information, vehicle proceeding directioninformation, vehicle rotation angle information, and altitudeinformation of a place where the vehicle is located on the digital photoimage captured by the camera 227 of the telematics terminal 200, andthis may be designed according to various methods by the person in theart.

The controller 403 may display the digital photo image having aplurality of pieces of POI information on the display unit 201, and whenparticular POI information is selected by the user from among theplurality of pieces of POI information, the controller 403 may set theselected POI information as a destination and guide a travel path from acurrent location to the set destination.

Hereinafter, the operation of the POI information providing apparatusaccording to a first embodiment of the present invention will now bedescribed with reference to FIGS. 4 to 8.

FIG. 5 is a flow chart illustrating the process of a method forproviding POI information according to a first embodiment of the presentinvention.

First, the controller 403 receives a digital photo image captured by thecamera 227 via an external device (e.g., a USB memory unit) or thecommunication unit 404. Here, the digital photo image received by thecontroller 402 may include location information or image capturedirection information, or include image capture angle information andaltitude information.

The controller 403 reads the location information and image capturedirection information from the received digital photo image (photo imagedata) (S11). For example, the controller 403 reads the received locationinformation of the place where the digital photo image has been capturedand the information about the direction in which the digital photo imagehas been captured.

Referring to the related art, a digital photo image may include variousroads and buildings (POI information), but information regarding roadsincluded in the digital photo image and information regarding buildingscannot be detected. However, in the present invention, the roadinformation and POI information corresponding to the locationinformation of the image capture place and the image capture directioninformation included in the captured digital photo image can beextracted from the map data, so the information regarding roads and theinformation regarding buildings included in the digital photo image canbe detected.

FIG. 6 illustrates a digital photo image captured by the POI informationproviding apparatus according to the first embodiment of the presentinvention.

As shown in FIG. 6, the controller 403 reads the location information,the image capture direction information, the image capture angleinformation and the altitude information from the received digital photoimage in order to extract the road information and the plurality ofpieces of POI information included in the received digital photo image.

Turning back to FIG. 5, the controller 403 reads the map datacorresponding to the location information and image capture directioninformation, which have been read from the digital photo image, from thestorage unit 213 (S12). Here, the controller 403 may read the map datacorresponding to the location information, the image capture directioninformation, the image capture angle information and the altitudeinformation, which have been extracted from the digital photo image,from the storage unit 213.

In order to match the digital photo image with the read map data, thecontroller 403 determines whether or not there is POI information and/orroad information in the read map data (S13). Here, the POI informationincluded in the read map data refers to major geographical figures andnatural features (e.g., a building name, a representative phone numberof a building, the address of a building) corresponding to the locationinformation and image capture direction information of the digital photoimage.

The controller 403 extracts the POI information and/or road informationfrom the read map data (S14). Here, when matching the digital photoimage to the read map data, the controller 403 matches POI informationand/or road information, excluding map within the read map data, to thedigital photo image. Accordingly, the POI information and/or roadinformation are displayed on the digital photo image.

FIG. 7 illustrates map data read by the POI information providingapparatus according to the first embodiment of the present invention.

As shown in FIG. 7, in order to match the digital photo image to theread map data, the controller 403 extracts the POI information and/orroad information from the map data corresponding to the locationinformation, the image capture direction information, the image captureangle information, and the altitude information of the digital photoimage.

Turning back to FIG. 5, the controller 403 records the extracted POIinformation and/or road information on the digital photo image (S15).Here, the controller 403 may transmit the digital photo image includingthe POI information and/or road information to a user who wants the POIinformation via the communication unit 404. Thus, multiple users may usethe POI information (including the road information) actually includedin the digital photo image.

FIG. 8 illustrates POI information (including road information) matchedto the digital photo image by the POI information providing apparatusaccording to the first embodiment of the present invention.

As shown in FIG. 8, the controller 403 extracts the POI informationand/or road information from the map data corresponding to the locationinformation, the image capture direction information, the image captureangle information, and the altitude information of the digital photoimage, and matches the extracted POI information and/or road informationto the digital photo image. Here, when a particular building is selectedfrom a plurality of buildings displayed on the digital photo image, thecontroller displays POI information (e.g., a building name, the addressof the building, a phone number of the building) corresponding to theselected building.

Hereinafter, the operation of the POI information providing apparatusaccording to a second embodiment of the present invention will now bedescribed with reference to FIGS. 4 and 9 to 13.

FIG. 9 is a flow chart illustrating the process of a method forproviding POI information according to a second embodiment of thepresent invention.

First, the controller 403 determines whether or not a POI photo imagelist (i.e., POI picture list) displayed on the display unit 201 isselected. The POI photo image list is linked to a plurality of digitalphoto images having the POI information and the road information andincludes a location list indicating locations of the digital photoimages.

FIG. 10 illustrates a POI photo image list key according to the secondembodiment of the present invention.

As shown in FIG. 10, the controller 403 determines whether or not a POIphoto image list key 10-1 displayed on the display unit 201 is selectedby the user. The selection may be manual or via a voice command.

If the POI photo image list key 10-1 displayed on the display unit 201is selected, the controller 403 displays the POI photo image list on thedisplay unit 201.

The controller 403 determines whether or not a particular location liston the POI photo image list is selected (S21). For example, thecontroller 403 determines whether or not a particular photo image linkedto a particular location list on the POI photo image list is selected.

FIG. 11 illustrates a POI photo image list according to the secondembodiment of the present invention.

As shown in FIG. 11, when the POI photo image list key 10-1 is selected,the controller 403 displays a POI photo image list 11-1 on the displayunit 201 and determines whether or not a particular location list (e.g.,Madison Ave., New York) is selected from the displayed POI photo imagelist 11-1. The selection may be manual or via a voice command.

When a particular location list is selected from the POI photo imagelist, the controller 403 displays a photo linked to the particularlocation list on the display unit 201.

FIG. 12 illustrates a digital photo image liked to the POI picture listaccording to the second embodiment of the present invention.

As shown in FIG. 12, when a particular location list is selected fromthe POI photo image list 11-1, the controller 403 displays a photo image12-1 linked to the particular location list on the display unit 201 (S22of FIG. 9).

The controller 403 determines whether or not particular POI informationis selected from the plurality of pieces of POI information included inthe displayed photo image (S23).

When particular POI information is selected from the plurality of piecesof POI information included in the displayed photo image, the controller403 generates a pop-up window requesting whether to set the selected POIinformation as a destination and displays the generated pop-up window onthe display unit 201 (S24).

FIG. 13 illustrates a pop-up window for setting POI information as adestination according to the second embodiment of the present invention.

As shown in FIG. 13, when particular POI information is selected fromthe plurality of pieces of POI information included in the displayedphoto image, the controller 403 generates a pop-up window 13-1 inquiring‘Want to set selected place (POI) as destination?’ and displays thegenerated pop-up window 13-1 on the display unit 201. Namely, thecontroller 403 determines whether to set the selected POI information asa destination.

When an OK key on the displayed pop-up window 13-1 is selected, thecontroller 403 sets the selected POI information as a destination (S25).

The controller 403 generates a travel path from the current location ofthe vehicle to the destination (the place corresponding to the POIinformation) set by the user and provides road guidance information tothe user base on the travel path (S26).

As so far described, the method and apparatus for providing POIinformation of the mobile terminal have the advantages in that becausethe POI information included -in the photo image captured by the cameracan be extracted, the POI information can be displayed on the capturedphoto image.

In addition, road guidance information can be provided based on the POIinformation included in the photo image captured by the camera.

As the present invention may be embodied in several forms withoutdeparting from the characteristics thereof, it should also be understoodthat the above-described embodiments are not limited by any of thedetails of the foregoing description, unless otherwise specified, butrather should be construed broadly within its scope as defined in theappended claims, and therefore all changes and modifications that fallwithin the metes and bounds of the claims, or equivalents of such metesand bounds are therefore intended to be embraced by the appended claims.

1. A method for providing POI information of a mobile terminal, themethod comprising: reading image capture location information and imagecapture direction information from a digital photo image; extracting POI(Point Of Interest) information corresponding to the image capturelocation information and image capture direction information from storedmap data; and displaying the extracted POI information on the digitalphoto image.
 2. The method of claim 1, further comprising: reading imagelocation altitude information and image capture angle information fromthe digital photo image, wherein the step of extracting comprisesextracting the POI information based on the read image location altitudeinformation and image capture angle information.
 3. The method of claim1, wherein the step of displaying comprises: matching the extracted POIinformation to the digital photo image.
 4. The method of claim 1,further comprising: recording the extracted POI information on thedigital photo image.
 5. The method of claim 1, wherein the step ofextracting of the POI information comprises: determining whether or notany POI information corresponding to the image capture locationinformation and image capture direction information is included in thestored map data.
 6. The method of claim 1, wherein the extracted POIinformation comprises road information corresponding to the imagecapture location information and the image capture directioninformation.
 7. The method of claim 1, wherein the step of displayingcomprises: displaying one or more of a name, an address, and a phonenumber of a building corresponding to the extracted POI information onthe digital photo image.
 8. The method of claim 1, further comprising:in response to a user input, selecting a location corresponding to thedisplayed POI information as a destination.
 9. The method of claim 8,further comprising: receiving a global positioning system (GPS) signaland generating first location data of the mobile terminal based on thereceived GPS signal; generating second location data based on a traveldirection of the mobile terminal and a mobile terminal speed; generatingan estimated mobile terminal location based on the first and secondlocation data; and providing route guidance information based on atravel path from the estimated mobile terminal location to thedestination.
 10. An apparatus configured to provide POI information of amobile terminal, the apparatus comprising: a storage unit configured tostore map data; and a controller configured to read image capturelocation information and image capture direction information from adigital photo image; extract POI (Point Of Interest) informationcorresponding to the image capture location information and imagecapture direction information from the stored map data; and display theextracted POI information on the digital photo image.
 11. The apparatusof claim 10, wherein the controller is further configured to read imagelocation altitude information and image capture angle information fromthe digital photo image, and extract the POI information based on theread image location altitude information and image capture angleinformation.
 12. The apparatus of claim 10, wherein the controller isconfigured to match the extracted POI information to the digital photoimage.
 13. The apparatus of claim 10, wherein the controller isconfigured to record the extracted POI information on the digital photoimage.
 14. The apparatus of claim 10, wherein the controller isconfigured to determine whether or not any POI information correspondingto the image capture location information and image capture directioninformation is included in the map data.
 15. The apparatus of claim 10,wherein the extracted POI information includes road informationcorresponding to the image capture location information and imagecapture direction information.
 16. The apparatus of claim 10, whereinthe controller is configured to display one or more of a name, anaddress, and a phone number of a building corresponding to the extractedPOI information on the digital photo image.
 17. The apparatus of claim10, wherein the controller is configured to select a locationcorresponding to the displayed POI information as a destination inresponse to a user input.
 18. The apparatus of claim 17, furthercomprising: a GPS module configured to receive a global positioningsystem (GPS) signal and generates first location data of the apparatusbased on the received GPS signal; a dead-reckoning sensor configured togenerate second location data based on a travel direction of theapparatus and an apparatus speed; a map matching unit configured togenerate an estimated apparatus location based on the first and secondlocation data; and a controller configured to provide road guidanceinformation based on a travel path from the estimated apparatus locationto the destination.
 19. A motor vehicle, comprising: an apparatusconfigured to provide POI information of a mobile terminal, theapparatus including: a storage unit configured to store map data; and acontroller configured to read image capture location information andimage capture direction information from a digital photo image; extractPOI (Point Of Interest) information corresponding to the image capturelocation information and image capture direction information from thestored map data; and display the extracted POI information on thedigital photo image.